-
Notifications
You must be signed in to change notification settings - Fork 10
vs/testrail-api-ex #542
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
vs/testrail-api-ex #542
Conversation
modules/testrail_script.py
Outdated
val = tr._get_test_cases(PROJECT_ID, suite_id) | ||
if val["size"] < val["limit"]: | ||
matching_cases = [ | ||
case for case in val["cases"] if case["custom_automated_test_names"] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is an interesting way to check if automation is done. Let's see if it works!
modules/testrail_script.py
Outdated
matching_case_ids = [case["id"] for case in matching_cases] | ||
|
||
if DRY_RUN: | ||
logging.info( |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Alright, run a dry run and post the ids of the cases you would have updated here. If they look good, I'll give you the go-ahead to run the script live. Thanks!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I still have some issues with this. I will handle it ASAP.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Have you dealt with these issues?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
2025-04-08 10:20:11,390 - INFO - TestRail Base URL: https://mozilla.testrail.io
2025-04-08 10:20:11,390 - INFO - Fetching suite IDs for suites: ['Printing', 'Startup and Profile', 'Reader View']
2025-04-08 10:20:12,368 - INFO - Suite IDs to process: [73, 2119, 2126]
2025-04-08 10:20:14,092 - INFO - Suite 73 has 2 completed automated case(s).
2025-04-08 10:20:15,273 - INFO - Suite 2119 has 1 completed automated case(s).
2025-04-08 10:20:16,211 - INFO - Suite 2126 has 3 completed automated case(s).
2025-04-08 10:20:16,211 - INFO - Total completed automated cases found: 6
2025-04-08 10:20:16,211 - INFO - [DRY RUN] Would update case 965139 → custom_automation_coverage = 3
2025-04-08 10:20:16,211 - INFO - [DRY RUN] Would update case 965142 → custom_automation_coverage = 3
2025-04-08 10:20:16,211 - INFO - [DRY RUN] Would update case 130792 → custom_automation_coverage = 3
2025-04-08 10:20:16,211 - INFO - [DRY RUN] Would update case 130908 → custom_automation_coverage = 3
2025-04-08 10:20:16,211 - INFO - [DRY RUN] Would update case 130912 → custom_automation_coverage = 3
2025-04-08 10:20:16,211 - INFO - [DRY RUN] Would update case 130919 → custom_automation_coverage = 3
Process finished with exit code 0
THis is what I currently have. Is this ok?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yep, that looks good, go ahead and run the script!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I did run it. Must I do something else?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Huh, seems like that didn't change the coverage values in TR. Did you only run the dry run, or have you also run it with dry run disabled (i.e. live)? If not, go ahead and do that. If so, there may be something wrong with the script.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I believe the update logic wasn't added and DRY_RUN wasn't turned off
modules/testrail_script.py
Outdated
env_file_path = os.path.join(project_root, "api_credentials.env") | ||
load_dotenv(dotenv_path=env_file_path) | ||
|
||
MY_SUITES = ["Printing UI", "Profile", "Reader View"] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
the correct suite list names are: ["Printing", "Startup and Profile", "Reader View"]
but I would confirm with @ben-c-at-moz
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes, I already updated this in my local change.
As I tested, this should finally be ok. |
Good job, this is done |
Testrail task exercise